Multi-viewpoint ontology construction and classification by non-experts and crowdsourcing: the case of diet effect on health
نویسندگان
چکیده
Domain experts are skilled to build a narrow ontology that reflects their sub-field of expertise. It will be grounded on their work experience and personal beliefs. We call this type of ontology a single-viewpoint ontology. There can be a variety of such single viewpoint ontologies for a given domain that represent a wide spectrum of sub-fields and expert opinions on the domain. But to have a complete formal vocabulary for the domain they need to be linked and unified into a multi-viewpoint model, while having the viewpoint statements marked and distinguished from the objectively true statements. We propose and test a methodology for multi-viewpoint ontology construction by non-expert users and crowdsourcing. The proposed methodology was evaluated in a large-scale crowdsourcing experiment with about 750 ontological statements. Typically, in crowdsourcing experiments the workers are asked for their personal opinions on the given subject. However, in our case their ability to objectively assess others' opinions is examined as well. Our results show substantially higher accuracy in classification for the objective assessment approach compared to the experiment based on personal opinions.
منابع مشابه
Subjective vs. Objective Evaluation of Ontological Statements with Crowdsourcing
In this paper we propose and test a methodology for evaluation of statements of a multi-viewpoint ontology by crowdsourcing. The task for the workers was to assess each of the given statement as true statements, controversial viewpoint statement or error. Typically, in crowdsourcing experiments the workers are asked for their personal opinions on the given subject. However, in our case their ab...
متن کاملAnalysis of the most important problems of rangelands and presentation of management solutions from the viewpoint of stakeholders and experts (Case study: Chaharbagh rangelands of Golestan province)
Background and objectives: Protecting rangelands and preventing the destruction of these valuable resources requires serious efforts and appropriate measures to ensure sustainable use and comprehensive and integrated management of rangelands, and these measures and planning should provide optimal and sustainable use of rangelands along with meeting the needs and improving the conditions of stak...
متن کاملPerform Three Data Mining Tasks with Crowdsourcing Process
For data mining studies, because of the complexity of doing feature selection process in tasks by hand, we need to send some of labeling to the workers with crowdsourcing activities. The process of outsourcing data mining tasks to users is often handled by software systems without enough knowledge of the age or geography of the users' residence. Uncertainty about the performance of virtual user...
متن کاملAssessment Optimization of Safety and Health Risks Using Fuzzy TOPSIS Technique (Case Study: Construction Sites in the South of Iran)
Introduction: Safety and health risk assessment in industries is associated with uncertainties due to the variables affecting it. Therefore, in this research, optimizing safety and health risk assessment was investigated in construction sites by combining a multi-criteria decision-making technique (TOPSIS) and a fuzzy system. In the present study, to answer this question, a new method was used ...
متن کاملA Comparison of Domain Experts and Crowdsourcing Regarding Concept Relevance Evaluation in Ontology Learning
Ontology learning helps to bootstrap and simplify the complex and expensive process of ontology construction by semi-automatically generating ontologies from data. As other complex machine learning or NLP tasks, such systems always produce a certain ratio of errors, which make manually refining and pruning the resulting ontologies necessary. Here, we compare the use of domain experts and paid c...
متن کامل